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AMENDMENTS TO THE SPECIFICATION 

The entire specification is presented with changes shown: 
5 Background of Invention 

1 . Field of the Invention 

The present invention relates to scaling digital pictures, and more particularly, to 
scaling digital pictures with reduced memory usage. 

10 

2. Description of the Prior Art 

In practice, scaling digital pictures is usually performed for still images or video 
frames to fit a specific application. The conventional method to scale a picture is to scale 
its horizontal dimension (width) first and then its vertical dimension (height), or vice 
1 5 versa. This requires a large buffer memory to store the results of scaling the horizontal 
dimension. 



Please refer to [[Fig. 1]] Fig. 1 and [[Fig.2]] Fig. 2 . [[Fig. 1]] Fig. 1 is a schematic 
diagram [[ofan]] of an up-scaJing process according to the prior art, and [[Fig.2]] Fig. 2 is 

20 a schematic diagramofa diagram of a down-scaling process according to the prior art. 

Wow and How are the old width and old height; W ncw and H new are the new width and new 
height; SRC is a memory for storing a source picture; DST is a memory for storing a 
scaled picture; and BUFFER [[isa]] isa memory for temporarily storing data during the 
scaling process. The method for performing a scaling process is to use the sampling 

25 formula at a new sampling point as [[Eq.l]] Eq. 1 . 

*(') - Y x(n)h(t - h) (Bqrl) (Eq. H 

Where x(t) is the new pixel value at the new sampling point t from n=0, x(n) is the 

2 
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original pixel value at index n, and h(t-n) is the value of an interpolation function shifted 
by t from index n. Furthermore, the coefficients i and j give the number of original pixels 
involved in reconstructing x(t), i.e. the number of original pixels involved is given by 
As a result, based on [[Eq.l]] EaJ., the scaling process can be realized by a 
5 filter-bank implementation. The number (i+j+ 1 ) gives the number of filter taps and h(n) is 
the tap weighting at n. The sampling process and the theory behind it are well known by 
those in the art, and accordingly it will not be discussed in detail here. 

Ideally, a large buffer memory provides the freedom for a scaling process to exploit 
10 filters of any length to achieve the required scaling quality. That is, the size of the buffer 
memory required is (W^Hm) bytes. However, from [[Fig.l]] FjgJ. and [[Fig.2]] Fi e . 2. 
the problem is when up-scaling the input picture the memory required increases 
dramatically. For example, if a picture is to be scaled to be two times larger in each 
dimension, the buffer memory required becomes (W new *Ho, d )=(2*W ol(1 *H old ). This high 
memory requirement is not feasible in some applications. In partioularly particular , this 
high memory requirement is not suitable for hardware implementation by integrated 
circuits (ICs). 



IS 



20 



Summary of Invention 

It is therefore a primary objective of the claimed invention to provide a method for 
scaling a digital picture with reduced memory to solve the above-mentioned problem. 

According to the claimed invention, a method for scaling a digital picture 
25 comprising following steps :(a) inputting a source picture to a source memory; (b) 
providing a first buffer and a second buffer; (c) determining scaling factors; (d) 
generating initial data in the first buffer and second buffer; (e) transferring a portion data 
of the digital picture from the source memory to the first buffer; (f) using a filter to scale 
the data in the first buffer in a first direction and storing the scaled data in the second 
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buffer; (g) using the filter to scale the data in the second buffer in a second direction and 
storing the scaled data in a destination memory; and (h) outputting a scaled picture from 
the destination memory. 

5 These and other objectives of the present invention will no doubt become obvious to 

those of ordinary skill in the art after reading the following detailed description of the 
preferred embodiment that is illustrated in the various figures and drawings. 

Brief Description of Drawings 

10 

[[Fig. 1]] Ei&J. is a schematic diagram [[ofan]] of an up-scaling process according to the 
prior art. 

[[Fig.2]] F\g^2 is a schematic diagram [[ofa]] ofa down-scaling process according to the 
prior art. 

1 5 [[Fig.3]] Fig^ is a schematic diagram [[ofan]] ofan up-scaling process according to the 

present invention. 

[fFig.4]] Fig^4 is a schematic diagram [[ofa]] o£a down-scaling process according to the 

present invention. 
[[Fig.5]] Fig. 5 is a flowchart according to the present invention. 
20 [[Fig. 6]] Fig. 6 is a flowchart of a preferred embodiment according to the present 

invention, 

[[Fig. 7]] £jjg. 7 is a schematic diagram of mirrored data extension. 



25 



Detailed Description 

Please refer to [[Fig.3]] Fig. 3 and [[Fig.4]] Fig. 4. [[Fig.3]] Fig. 3 is a schematic 
diagram ofan up-scaling process according to the present invention, and [[Fig.4]] Fig.4 
is a schematic diagram ofa down-scaling process according to the present invention, 
where SRC is a memory for storing a source picture, and DST is a memory for storing a 

4 
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scaled picture. The size of the first line-buffer BUFFER 1 is (m*Woki) bytes and the size 
of the second-buffer BUFFER2 is (n* W new ) bytes, where m and n are the number of lines 
for the first and second buffers and depend on the length of the filter used. That is, if the 
length of the interpolation filter is L, then m - L and n = (2*L-1). Furthermore, the 
function of the buffer BUFFER 1 is to store data needed for horizontal scaling as well as 
to store the decimated picture data. The BUFFER 1 is not necessary if the source picture 
can be randomly accessed from the memory SRC. On the other hand, the function of the 
BUFFER2 is to store the horizontally scaled results as well as to organize the data for 
vertical scaling. 



Please refer to [[Fig.5]] Fig. 5 . [[Fig.5]] Fig. 5 is a flowchart according to the 
present invention. In step 210, the picture to be scaled is inputted and stored in the 
memory SRC. In step 220, the scaling operation for the picture is determined as being 
up-scaling or down-scaling. If the picture is to be up-scaled, during step 221, rows of 

1 5 picture data are transferred to the buffer BUFFER1 . If the picture is to be down-scaled, 
during step 222, the data decimation operation is determined. If the decimation operation 
is enabled, rows of the picture data are decimated when necessary and transferred to the 
buffer BUFFER1 . Otherwise, rows of picture data are transferred to the buffer BUFFER 1 . 
In step 230, the horizontal scaling process is performed and the results are stored in the 

20 buffer BUFFER2. In step 240, the vertical scaling process is performed and the results are 
outputted to the memory DST. In step 250, if the picture has data remaining to be scaled, 
repeat step 220 to step 240 until all rows of the picture data have been horizontally and 
vertically scaled. Finally, the step 260 is executed to finish the scaling process. 

25 Please refer to [[Fig.6]] Fig. 6 . [[Fig.6]] Fig. 6 is a flowchart of a preferred 

embodiment according to the present invention. For clearly explaining the spirit of this 

invention, the preferred embodiment of this invention exploits a 4-tap interpolation filter 

to perform the scaling process. Furthermore, the up-scaling ratio is assumed to be up to 

twice as large as the original picture in each dimension, but the down-scaling ratio is not 

5 
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limited. Therefore, the size of the buffer BUFFER 1 is 4*W old bytes and the size of the 
buffer BUFFER2 is 7*W new = 14*W oM bytes, as W new = 2*W old . For conveniently 
explaining the processing steps in the flowchart, the whole process can be divided into 
three groups, namely the initialization steps, horizontal scaling steps, and vertical scaling 
5 steps. 



In the group of initialization steps, the picture to be scaled is firstly inputted and 
stored in the memory SRC. After that, the scaling factors and the decimation factors are 
determined. Initially, the horizontal and vertical scaling factors are respectively given by 
10 S h = W old /W new and S v = H oW /H new , where W 0 | d and H o]d are respectively the width and 
height of the input picture, and W new and H new are respectively the width and height to be 
scaled to. The initial horizontal scaling factor S h determines whether the picture data will 
be decimated in the horizontal direction before being transferred to the buffer BUFFER 1 . 
That is, if the decimation operation is enabled and S h > 2, then picture data is decimated 

1 5 horizontally according to the horizontal decimation factor d h = floor(log2S h ), where the 
floor function truncates the decimal portions; otherwise, no horizontal data decimation 
will be performed and set d h = 0. Similarly, the initial vertical scaling factor Sv 
determines whether the picture data will be decimated in the vertical direction before 
being transferred to the buffer BUFFER 1. That is, if the decimation is enabled «*tSv^-3 

20 and S v > 2 , then picture data is decimated vertically according to the vertical decimation 
factor d v = floor(log2S v ); otherwise, no vertical data decimation will be performed and set 
d v = 0. As a result, according to the picture decimation process, the data in the memory 
BUFFER 1 and the memory SRC can be generally expressed as: 
BUFFERl(x,i) = SRC(2 dh *x,2 dv *(y+i)), 

25 where x ranges from 0 to ( W c i d - 1 ), y ranges from 0 to (H old - 1 ) and i ranges from 0 to 3 . 

Since after decimation the width and height of the input picture will become W d = 

Wou/dh and H d = rWd v , the actual scaling factors used in the scaling process are referred 

to as S h = W d /W new and S v = H d /H new . After determining the decimation and scaling factor, 

6 
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the initial horizontal scaling process is preformed. In this process, two lines of SRC data 
are transferred to the buffer BUFFER 1 , such as: 
BUFFERl(x,0) = SRC(2 dh *x,0), 
BUFFERl(x,l) = SRC(2 dh *x,2 dv ), 
5 where x ranges from 0 to (W d -1). 

Based on [[Eq.l]] Eq. 1 , the initial horizontal scaling process on these two lines of data 
becomes: 

BUFFER2(x2 9 S) - Y BUFFER\{x\ + w,0) * w(n) , and 

BUFFER2(x2,6) «= Y BUFFER\(x\ + «,1) * w(n) 

10 where x2 ranges from 0 to ^Wfte^a»4 (W nnV -n and xl = floor(Sh*x2), which 

noglcot3fractionQl neglects fractional portions. The result of the initial horizontal scaling 
from rowO and row 1 of the buffer BUFFER 1 is respectively stored in row5 and row6 of 
the buffer BUFFER2. The practical implementation of the scaling process and the method 
of obtaining w(n) are clear to those skilled in the art and will not be discussed here. 

15 However, one thing that should be mentioned is that the boundary conditions are treated 
as a mirror-extension process. 

Please refer to [[Fig. 7]j Fig. 7 . [[Fig.7]] Fie. 7 is a schematic diagram of mirrored 
data extension. There are two options, and each option uses one row of the buffer 
20 BUFFER 1 with the width of W as an example. 
In option 1 : 

BUFFERl(-l) = BUFFER 1(0), 
BUFFERl(W) = BUFFERl(W-l), and 
BUFFERl(W-H) = BUFFER l(W-2). 
25 In option 2: 

BUFFERl(-l) = BUFFER 1(0), 
BUFFER 1(W) = BUFFER1(W-1), and 

7 
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BUFFER1(W+I) = BUFFERl(W-2). 

Finally, in the last step of the initialization steps, the vertical index pointers y and y2 are 
both set to 0, where y is the vertical index counter for the memory SRC and y2 is the 
vertical index counter for the memory DST. The functions of pointers y and y2 will be 
5 clear in the following discussion. 

In the group of the horizontal scaling steps, the first step is to re-arrange the buffer 
BUFFER2 as follows: 

BUFFER2(x2,0) « BUFFER2(x2,5) ify = 0, 

10 BUFFER2(x2,0) = BUFFER2(x2,4) if y 0, 

BUFFER2(x2,l) = BUFFER2(x2,5), 
BUFFER2(x2,2) = BUFFER2(x2,6), 

BUFFER2(x2,5) = BUFFER2(x2,4) ify ^ (H d -7), 

BUFFER2(x2,6) = BUFFER2(x2,3) ify ^ (Ha-7), 

1 5 where x2 ranges from 0 to ( W new - 1 ). 

After that, more rows of picture data are transferred from the SRC to the buffer 
BUFFERl,suchas: 

BUFFER 1 (x,0) = SRC(2 dn *x 1 2 dv (y+2)) 5 
BUFFERl(x,l) - SRC(2 dn *x,2 dv (y+3)) > 
20 and if y < (Hi-7), then 

BUFFERl(x,2) = SRC(2 dn *x,2 dv (y+4)), 

BUFFER l(x,3) = SRC(2 dn *x,2 dv (y+5)), 

where x ranges from 0 to (W d -1). 

The horizontal scaling process is given as follows: 

2 

25 BUFF£R2(x2 i 3) - \ BUFFER\(x\ + nfi) * w(n) , and 

ft — i 

2 

BUFFER2(x2A) - Y BUFFER\(x\ + «,!)* ; 

«— i 

8 
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and if y < (Hd-7), then 

2 

BUFFER2{x2 y 5) - X BUFFER\(x\ + w,2) * w(n) , and 
BUFFERING) « V BUFFERl(x\ + *,3) * vv(w) , 



n— 1 



5 horizontal scaling results from rowO and rowl of the buffer BUFFER1 are saved to row3 
and row4 of the buffer BUFFER2, respectively. Also, if y is smaller than (H d -7), then the 
scaling results from row2 and row3 of the buffer BUFFER 1 are saved to row5 and row6 
of the buffer BUFFER2. 

10 In the group of vertical scaling steps, the first step is to let y I = floor(S v *y2). After 

that, if yl satisfies y ^ yl < (y+4) and y2 satisfies y2 < Hn*w, then the vertical scaling 
process is performed as follows: 

2 

DST(x2,y2) « ^ BUFFER2(x2 9 y\ + n) * s 

«— i 

where x2 ranges from 0 to (W new -1). After the vertical scaling process, the vertical index 
15 pointer y2 is incremented by 1, i.e. y2 = y2+l . Finally, the process returns to the first step 
of the vertical scaling steps. On the other hand, if yl does not satisfy y ^ yl < (y+4) or 
y2 does not satisfy y2 < H ne w> then the vertical index pointer y is increased by 4, i.e. y = 
y+4. After that, the range of y is verified; if y is smaller than (H d -3), then the entire 
scaling process bog i noagain begins again from the first step of the horizontal scaling 
20 process. Otherwise, the scaling procedure has been accomplished and all processes are 
terminated. 



In contrast to the prior art, the present invention provides a line-buffer scaling 
method that enables horizontal-scaling and vertical-scaling processes to use the same 
25 number of filter taps for achieving the best possible quality, while the buffer memory 
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requirement is kept to be as small as possible and is proportional to the filter length. 
Therefore, this low-memory scaling method is suitable for the case when system memory 
available is constrained. 

Those skilled in the art will readily observe that numerous modifications and 
alterations of the device may be made while retaining the teachings of the invention. 
Accordingly; the above disclosure should be construed as limited only by the metes and 
bounds of the appended claims. 
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